12 

previous time step. 

We note that this algorithm requires that a strategy with the greatest 
anticipated benefit can be computed efficiently. The following lemma 
provides this requirement when the input describes the states explicitly. Note 
that we cannot apply this lemma to the Web server farm problem since here 
the states are implicit and of exponential size, so we useAe offlinealgorithm 
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described in copending patent application Serial No. 09/__, (IBM Docket 1 

YOR9-2000-0824US1). 


y± Lemma 1. A strategy with the largest anticipated benefit can be computed in 

— 

S 1 0 time that is polynomial in the number of states. 

□ 
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u Proof. Use dynamic programming that goes interactively over the time steps 

■£ and accumulate discounted benefits. As the additional benefit of the next time 

step depends only on the current state, it suffices to have a table of size 

p I proportional to the number of states. 

6 
=p 

Q 1 5 Theorem 2. The above discounting algorithm has competitive ratio at most 


Proof. Consider the online algorithm at time /, and denote by b 0 , &„ . . .,b L the 
sequence of benefits in the strategy with the largest anticipated benefit over all 
strategies that the online algorithm has at time t. Define ON, = b 0 and 
20 ONl\ = b x l(t+...*b L la L , then ON t +ON*![ is the largest anticipated benefit 
over all the strategies that are available to the online algorithm at time t. Since 
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